Fluctuating thermodynamics of active Brownian particles 
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Examples of self propulsion in strongly fluctuating environment is abound in nature, e.g., molec- 
ular motors and pumps operating in living cells. Starting from Langevin equation of motion, we 
develop a fluctuating thermodynamic description of self propelled particles using simple models of 
velocity dependent forces. We derive fluctuation theorems for entropy production and a modified 
fluctuation dissipation relation, characterizing the linear response at non-equilibrium steady states. 
We study these notions in a simple model of molecular motors, and in the Rayleigh-Helmholtz and 
energy-depot model of self propelled particles. 



PACS numbers: 05.40.-a, 05.40.Jc, 05.70.-a 



I. INTRODUCTION 

Living systems are by definition open and active, stay- 
ing away from equilibrium by consuming and subse- 
quently dissipating energy, thereby generating forces and 
motion. Subcellular components, e.g., motor proteins, 
cytoskeletal filaments etc. operate in a noisy environ- 
ment, where fluctuations arise from thermal motion and, 
in many cases, chemical reactions 1]. In contrast to con- 
ventional Brownian motion where the forces acting on 
a particle are entirely due to external sources, the ac- 
tive Brownian particles can generate their own forces [2[ 
utilizing chemical energies [l|. 

Traditional thermodynamic description in terms of av- 
erage quantities does not provide satisfactory description 
of small assembly of colloidal particles, or nano-materials 
due to the presence of strong thermal fluctuations. In the 
last two decades, a theoretical framework has emerged 
that allows several exact relations for distributions of 
fluctuating quantities like work, heat and entropy charac- 
terizing individual trajectories of the particles |3l— Tl3j| . At 
non-equilibrium steady states (NESS) entropy a is con- 
tinually produced, with its probability distribution obey- 
ing dim 



P(-a) 



exp(a/k B ) 



(1) 



This is known as the detailed fluctuation theorem (DFT) 
and was first observed in simulations of sheared liq- 
uids [13[ and later derived using chaotic [l2[ and stochas- 
tic dynamics 0, [l(|. For asymptotic steady states the 
above relation is obeyed with a = As m , As m being the 
change in entropy of the medium alone. If one consid- 
ers the stochastic change in system entropy As as well, 
a = Astot = As + As m signifying the total entropy 
change, the DFT remains valid even for finite time mea- 
surements |14J. Further, Astot obeys an integral fluc- 
tuation theorem (exp(— Astot/ks)) = 1 where (. . .) de- 



notes non-equilibrium average over fluctuating trajecto- 
ries. This is closely related to the Jarzynski equation, 
that expresses equilibrium free en ergy difference in terms 
of non-equilibrium work done [3, lll| . These fluctuation 
theorems were verified in exp eriments on colloids |15l - 
ll7J . and granular matter [l]|, an d successfully used to 
find out the free energy landscape of RNA Qj], [20j | . 
Fluctuation theorems were also derived for the flashing 
ratchet [2l], [22| , and other detailed models of molecular 
motors and enzymes [23[. However, given the complexity 
of living systems it may not always be possible to iden- 
tify and model all the chemical processes and mechano- 
chemical coupling responsible for autonomous force gen- 
eration. Recently, the DFT was applied to measure the 
torque generation by a rotory motor FiATPase from its 
fluctuating trajectory [24J . This idea may be extended to 
other types of molecular motors to measure autonomous 
force or torque generation from their stochastic trajecto- 
ries 
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Response in equilibrium states is characterized by the 
fluctuation-dissipation theorem (FDT), and the ratio of 
correlation and response is often interpreted as effec- 
tive temperature of systems at NESS [26|, (27[. Re- 
cent theoretical work derived several forms of modified 
fluctuation-dissipation relations (MFDR) characterizing 
linear response at NESS and established additive cor- 
rection to FDT due to the presence of non-zero steady 
state currents [28| - |34J . thus showing that phenomenologi- 
cal characterization of active processes by effective tem- 
peratures is not consistent. Some of the theoretical pre- 
dictions were verified experimentally |35l . |36| . 

In this paper, we use stochastic Langevin motion of self 
propelled particles (SPP) to develop fluctuating thermo- 
dynamics. We assume that the self-propulsion force is 
velocity dependent, however, the details of the propul- 
sion mechanism is not specified to begin with. Using 
this assumption, we derive a general form of fluctuat- 
ing thermodynamics of SPPs in terms of energy balance 
and fluctuation theorems involving entropy production. 
In particular, we identify the contributions in entropy 
production due to self-propulsion and its coupling to 
external drive. We also derive a modified fluctuation- 
dissipation relation characterizing the linear response at 



steady states of SPPs. Finally, we apply our theoreti- 
cal development on some specific model systems: a sim- 
ple model of molecular motors, and models utilizing ve- 
locity dependent forces as self propulsion mechanism, 
namely, the Rayleigh-Helmholtz model and the energy- 
depot model. 



II. LANGEVIN EQUATION AND THE LAWS 
OF THERMODYNAMICS 



To develop the notions of fluctuating thermodynam- 
ics of SPP systems, let us focus on one dimension (Id), 
for simplicity. Simplest models of SPPs, like that the 
Rayleigh-Helmholtz model or the energy-depot model, 
use velocity dependent autonomous force F(v) to model 
self-propulsion. The Langevin equation for the motion of 
each particle evolving in the presence of a time dependent 
external force f(t) has the form 



dU(x) 

V = -jv + r] + F(v) -i-2+/(t) 

ox 



where — jv is viscous dissipation, r\ is Gaussian white 
noise characterized by {r\(t)) = 0, (i](t)i](t')) = 2D 6(t — 
t') with D — ^jksT, U{x) denotes conservative potential 
due to inter-particle interaction or external source. We 
use particle mass m = 1, unless otherwise specified. 



A. First law 

Multiplying the above equation by velocity v and inte- 
grating over a small time interval t we obtain a first law 
equivalent for each particle [33] 



AE = AQ + AW + AQ r 



(3) 



where E = (l/2)w 2 + U(x) is the internal energy, AQ = 
J T dtv.{—"fv + if) is the energy flow from the heat bath, 
AW — J dtv.f{t) is the work done on the particle, and 
AQ m = J dtv.F(v) is the amount of energy flow from 
the internal motor degrees of freedom of the SPP to me- 
chanical motion. This last part is what differentiates 
an SPP from a usual Brownian particle. Adding these 
contributions over all the particles in a system leads to 
an equivalent of the first law of thermodynamics for the 
whole system. It is straightforward to extend this rela- 
tion to higher dimensions. 



B. Fluctuation theorem: connection with second 

law 

Consider the time evolution of the system from t = 
to t through a path defined by X = {x(t),v(t), f(t)}. 



The probability of this path is given by 

i r . i . au 



V+ =7Vexp 



4D. 



At 



o Jo 



ffO) 



dx 



-fit) 



(4) 



where TV is the normalization constant, and we used 
g(v) = —jv + F(v) to bring together all the veloc- 
ity dependent forces in Langevin equation. Reversing 
the velocities gives us the time reversed path X^ = 
{x'{t>), v'(t>), f(t')} = {x(r-t),-v(r-t)J(r-t)}, the 
probability of which can be expressed as 



■■ A/"exp 



4L>, 



dt 



o Jo 



■9(v) 



dU 

dx 



fit) 



(5) 



where in the last step it was assumed that g(v) is an odd 
function g(— v) = —g(v). This condition is naturally sat- 
isfied in many SPP models that assume energy transduc- 
tion from internal energy source to kinetic energy [38j , as 
will be illustrated further in the following sections. Thus 
the ratio of the probabilities of the forward and reverse 
paths comes out to be 



(2) £ = 



V- 



= exp 



1 

A) 



— / dt 



£-'<« 



9(v) 



After some algebra one finally gets (see Appendix-|A^) 



V- 



exp 



(3 [AQ + AQ m + AQ e 



-A6 

7 



(G) 



where f3 — 1/ksT = j/Do. In the above relation we have 
used AQ and AQ m as identified in the derivation of the 
first law. The term jAQ em = / Q T dtF(v).(f(t) - d x U) is 
due to the coupling between the internal motor degrees 
of freedom and mechanical forces. This can be inter- 
preted as an energy flow to motor from external forces 
and inter-particle interactions. In deriving the above re- 
lation F(v) = —d<p(v)/dv was used, where <^(f) is a ve- 
locity dependent potential due to the internal motor of 
SPPs. 

Ecj-© gives the ratio of the probabilities of forward 
and reverse paths, given that the forward evolution takes 
the system from some initial state i to some specific final 
state /. Assuming that the normalized probability dis- 
tribution of these two states are 7r^ and 7r/ respectively, 
the ratio of the forward and the reverse process is 

p f (x) _ ^r+ 

P r (Xt) K f V- 



e As/k B e -/3(AQ+AQ m +AQ cm + i Aq 

exp[As//fc s ] 



(7) 

where we used the fluctuating entropy content cor- 
responding to the distributions of initial and final 
states of the SPP system given by the relation Sij — 
—kB^TTij pj}) such that fti/ftf = exp(As/fcs). The 
total entropy production in the forward process is 

As f = As-- ( AQ + AQ m + AQ em + -A<t> 

= As - i (AE -AW + AQ em + -aA , (8) 



where in the last step we used the first law given by 
Eq.©. 

The main contribution of this paper is the identifica- 
tion of this total entropy production Eq.© which con- 
tains two new terms as compared to a system of tradi- 
tional Brownian particles. These are the energy exchange 
between the motor's internal degrees of freedom and the 
external mechanical forces AQ ern , and a change in the 
velocity dependent potential A<j). Both these contribu- 
tions disappear once the motor activity of the self pro- 
pelled particles is switched off. Note that both AQ em 
and Acj)(v) are hidden from the perspective of the first 
law, but appears in the expression of the total entropy 
change. This is due to the intrinsic open nature of the 
system with respect to the self propulsion mechanism. 

Eq.© implies the integral fluctuation theorem Q 



-As f /k B \ _ 



PM^PHl) 



Pf(X) 
= Jv[X^]P r (X^ = l 



(9) 



Using Eq. © for the total entropy production As/ in the 
forward process driven by a specific force protocol f(t) 
one can find a modified Jarzynski- type relation 



-0AW\ 



/ e -/3AA e -/3(AQ cm +A0/ 7 )\ 



(10) 



where AA = AE — TAs would have been the canon- 
ical Helmholtz free energy difference if the initial and 
final states were at equilibrium. In the absence of mo- 
tor driving, AQ em ~ and A<fi = 0, the above rela- 
tion leads to the Jarzynski equation (cxp(— f3AW)) — 
exp(-0AA) [HI. 

Note that the total entropy production in the forward 
process (As t ) = D(P f \\P r ) = fV[X]P f (X)\n(P f /P r ) 
is the Kullback-Leibler distance between the probabil- 
ity distributions characterizing the forward and the re- 
verse processes. Using Jensen inequality one obtains from 
Eq.CEl 



C. Fluctuating thermodynamics at NESS 

It can be shown that at NESS the detailed fluctuation 
theorem (see Appendix-lBJ) 



p(Afl t ) 

P(-As t ) 



_ gAst/fcjE 



(13) 



holds, where Ast is the total entropy change along any 
trajectory. In the absence of interaction U(x) = 0, the 
time evolution under a constant external force, 



-jv + F(v) + f + 7]. 



(14) 



Writing g(v) — —jv + F(v) + f = —dip(v)/dv, the cor- 
responding Fokker-Planck equation has the form 



d tP {v,t) = D d v [e-W D °d v (e*/ D °p) 
with a steady state solution 



Ps(v) 



-i>(v)/D 



(15) 



(16) 



where the normalization Z = J_ dvexp(—ip(v)/Do). 
Using F(v) = —d v (/)(v) one obtains ip(v) — {jv 2 /2 — 
fv) + <j){v). At NESS entropy is continually produced, 
and 



££ = „( aE + ^_I a(/ „ : 

k B \ 7 7 



(17) 



where E = v 2 /2 is the kinetic energy of the SPP. There- 
fore the corresponding change in the total entropy (Eqj8]) 
is 



^ = /3 (--A(fv) +AW- AQ e 
k B V 7 



(18) 



This expression of Ast will obey the integral and the 
detailed fluctuation theorems derived in Eq.s ^ and ([13")) 



(As t )=D(P f \\P r )>0 ) 



(11) 



i.e., any non-equilibrium process in SPP is associated 
with a maximization of the total non-equilibrium entropy 
St = ( s t)- This notion should be contrasted against the 
equilibrium entropy maximization. 

The principle of non-equilibrium entropy maximization 
is equivalent to the minimization of a non-equilibrium 
free energy like term AG m < where 



G m = [E-TS-W] 



4>h 



(12) 



with S = (s) denoting the average system entropy. In 
the absence of motor activity, Q em = 0, <f> — and G m 
reduces to equilibrium Gibbs free energy G = E — TS — 
W. 



III. LINEAR RESPONSE AT NESS: MODIFIED 
FLUCTUATION DISSIPATION RELATION 

The Fokker-Planck equation corresponding to Eq.® 

is 

d t p(x, v, t) = C(x, v, h)p(x, v, t) = (C + h(t)Ci)p (19) 

where 

C Q p = -d x {vp) - d v [g(v) - d x U] p + D d 2 p 
dp = -d v p. 

Here we replaced the external force /(£) by h(t) denoting 
a weak time dependent perturbation around the steady 
state. Assuming that the SPP system goes to a steady 



state characterized by a distribution function p s obeying 
£>oPs = 0, linear response around this steady state is 
described by miH 



5h(t>) 



= (A{t)M{t')) s 



(20) 



where (■ ■ -) s indicate a steady state average, and M — 
(l/p s )Cip s . 

The steady state distribution of Eq. (IT51) leads to M = 
d v [-ln Ps ] = 4>'(v)/D a = -g(v)/D^ = ( 7 v - F(v))/D . 
Therefore the response function is given by 

fff - ^W)M*')-W))]>. 

This is the modified fluctuation dissipation relation 
(MFDR) characterizing response function at NESS of 
SPP. In the absence of self propulsion, F(v) = 0, one 
gets back the equilibrium fluctuation dissipation theorem 
(FDT). The velocity response to external force is 



x(M') = 



8h(t>) 



= P(v(t)v(t'))-—(v(t)F(v(t'))}(22) 



Since the correction in MFDR at NESS with respect 
to the equilibrium FDT is additive (see Eq. |2"2"|) . not 
multiplicative, a ratio of the correlation and response 
(v(t)v(t'))/x(t,t') can not, in general, be interpreted as 
an effective temperature, with the only possible excep- 
tion being when F(v) is a linear function of velocity v. 

In the following, we consider some specific models of 
self propelled particles and analyze their behavior using 
the formalism developed so far. 



IV. MODELS OF SPP 

In this section we consider three specific models of 
SPP. The first one mimics the linear force-velocity re- 
lation of Kinesin like motor proteins [40j. The second 
model, known as the Rayleigh-Helmholtz model [38] has 
been useful to describe the collective motion of a bunch of 
motor proteins working in tandem to move appropriate 
cargo [411 The third model is known as the energy-depot 
model [3 a . |42j , which utilizes a simple coupling between 
internal energy production and mechanical motion as a 
self propulsion mechanism. 



modeled through a linear force- velocity relation [43J. Let 
us assume the autonomous force produced by the motor 
is a constant f s . In the presence of an external load —A 
acting opposite to the motor movement, the Langevin 
equation is 



v = -71' + 7/ + f s - A. 



(23) 



In the over-damped limit, this leads to the linear force- 
velocity relation (v) = t>o(l — A// s ) with vq = f s /j 
the autonomous velocity of free motors, and f s the stall 
force. In molecular motors, the mechano-chemical pro- 
cesses leading to self propulsion, in general, may elevate 
the noise level, change the noise correlation, and change 
the viscous drag. However, in this simple model we as- 
sume that the noise can still be regarded as white if the 
time resolution is not too small, and the effective diffu- 
sion constant contains the impact of chemical reactions. 
The Langevin equation can be rewritten as » = 
—ip'(v) + r\ where ip'(v) = "fv — f s is obtainable from 
-0(tj) = (j/2)(v — «o) 2 - Thus the steady state distribu- 
tion (see Eq. p^j) is a Gaussian peaked at vq 



P s (v) 



■ exp 



/? 



(V-V )' 



(24) 



1. Entropy production at NESS 

In calculating entropy, let us treat f s similar to an 
external force. The total entropy production can be ob- 
tained from Ea. (TT8"|) . In this case F(v) = = (j>(v), thus 
AQ em = 0. The total fluctuating entropy production 



As t 
k B 



P 



-f s Av + AW 

7 



(25) 



with AW = f s J vdt. The integral and the detailed 
fluctuation theorems of Eq.s © and (fL3")l will be obeyed 
by this total entropy change at steady state. 

One can extend this calculation to rotating motors, 
by replacing linear displacements by rotation, velocities 
by angular velocities, and forces by torques. Note that 
for measurements over asymptotically long time r, AW 
in the above expression becomes predominant and hence 
Ast/ks = J3AW as has been used in recent experiments 
on FiATPase (2I. 



2. Entropy production at oscillatory steady states 



A. Molecular motors 

Molecular motors, e.g., kinesins move on polymeric 
tracks, e.g., microtubules in a highly stochastic but di- 
rected manner utilizing chemical energy from ATP hy- 
drolysis. In the presence of load force acting in the di- 
rection opposing their motion, they slow down and even- 
tually stop moving. This behavior can be approximately 



In the presence of a time-dependent external force the 
Langevin equation describing the molecular motor is 



V 



- lv + ri + f s +f(t), 



(26) 



with the general solution at initial condition independent 
asymptotic states 

v(t) = v + f dt'e-^-^ifit'J + riit')]. 
Jo 



Thus v(t) is a linear functional of Gaussian noise r](t'), 
implying that the probability distribution of v(t) at this 
state is also Gaussian, 



where 



P(v,t) = J^exp(-^(v-(v(t))) 2 



(«(*)) =v + dt'e-^-^fi?). 



(27) 



If the external force is sinusoidal /(£) = Asinwt, the 
mean velocity at the asymptotic oscillatory state is 



(v(t)) = v 



A 



Y +uj< 



[us (1 — cos cot) + j sin uit) . (28) 



The change in system entropy between any two times 
t\ and t% is As/ks = — In\p(v2,t2) /p(v±,ti)] and can be 
expressed as 



As/k B = p(v - (v))(Av - A(v)) 



(29) 



with v — (t>2 + v\)/2 and Av = v% — V\. Thus the in- 
tegral fluctuation theorem of Eq. © is obeyed by the to- 
tal entropy production between any two asymptotic non- 
equilibrium oscillatory states 



As t 



fi[AW - (v)Av-(v- (v))A(v)}. (30) 



B. The Rayleigh-Helmholtz model 



one assumes a 

2 i fu/A\„A 



In the Rayleigh-Helmholtz model [4 
velocity dependent potential </>(«) = ~{a/2)v 2 + (b/A)v 
so that the self propulsion force F(v) = —d>'(v). This 
force is often interpreted in terms of a non-linear velocity 
dependent friction 71 (v) such that F(v) = — 7i(w)i> with 
71(f) = — a + bv 2 where —a acts like a negative friction. 

This model in the deterministic limit has two fixed 
points at 11 = zLy/a/b. In presence of stochastic noise, 
thus, the velocity can switch between positive and neg- 
ative directions. In the presence of a positive friction 
7, for a > 7 this model generates an effective negative 
friction 7' = 7 — a, and pumps energy into the SPP. 
This model has recently been used in various studies of 
SPPs |2a, I4a - l47j | , and describes the bimodal velocity dis- 
tribution of microtubules under the collective influence 
of a set of bidirectional motor proteins NK11 |4l| . 



1. Entropy production at NESS 

In the presence of an external force A all the forces can 
be clubbed together as —ip'(v) — —jv + F(v) + A leading 
to ip(v) = (7/2)w 2 + <j){v) - Xv = (7/2)w 2 - {a/2)(v - 
v\) 2 + (fe/4)w 4 with v\ — (A/a). Therefore, using Eq.([T| 
we find the steady state distribution 



3. Linear response at NESS 

It is straightforward to obtain the velocity response to 
a perturbing force around a steady state of free molecular 
motors using Eq. (|22"l) 



k R T 



5{v(t)) 
5h{t') 



(v(t)v(t')) s -v 2 



(31) 



Using the Langevin equation, one can directly calculate 
the two-time correlation function 



(v(t)v(t')) s = v 2 + fc B Te-Tl*-*'l 



(32) 



Ps(v,\) = 7?exp 



^[Y'2 {v ' Vx) + T 



.(34) 



where a = a/7 and v = 6/7 quantifies the amount of 
pumping. The corresponding fluctuating entropy content 
is s = —ks hips. Within this model, the steady state has 
zero current in absence of external force A which keeps 
the system out of equilibrium. 

It is straightforward to use Eq. (fT8)) to obtain the to- 
tal entropy production between two microstates within a 
NESS. In a transformation from an initial state p s {vi, A) 
to a final state p s (vf, A), 



Thus one obtains an equilibrium-like response 



S(v(t)) 
5h{t>) 



= e -7l*-t'l. 



(33) 



The Id motion of molecular motors considered here 
is same as Brownian motion in presence of an external 
force. In higher dimensions, constant self propulsion f s 
along with a steering of the direction of motion contrasts 
the properties of such SPPs from traditional Brownian 
motion under external field [38j . In Id, such steering is 
equivalent to switching the direction of motion from for- 
ward to backward. This is achieved in the following ex- 
amples by using velocity dependent self propulsion forces. 



Aft 
kn 







-av x 



(v f - ^) + AW - AQ e 



(35) 



where the work done AW ~ \J vdt, and AQ em — 
(A/7) f dtF(v) = a AW -vAWo, v AW = v f v 3 dt 
having the dimension of energy. Thus we have 



As t 
ks 



= P 



-av x 



(v f -^-]-(a-l)AW + AWo .(36) 



This Ast obeys the integral and detailed fluctuation the- 
orems described by Eq.s © and ([H 



2. Linear response at NESS 

The modified fluctuation dissipation relation, in this 
case, has the form 



X(M') = P{v{t)v{t')) t 



1 



(v(t)[av(t')-bv 3 (t')}) 



= -(3(a - l)(v(t)v(t')) s + pv(v(t)v 3 (t')) a (37) 

where (. . .)„ is the steady state average in the absence of 
external force. Note that at equilibrium a = = v, and 
we get ksT as the fluctuation dissipation ratio. However, 
in general this ratio (v(t)v(t'))/x(t, t') depends on higher 
order correlation. Thus the effective temperature defined 
as a fluctuation-response ratio does not characterize the 
NESS. 



3. Entropy production: external harmonic trap 

If a free SPP of the Rayleigh-Helmholtz type is sub- 
jected to an external harmonic trap potential \kx 2 , the 
initial steady state described by Eq. (|3~4")l undergoes trans- 
formation to a final steady state achieved in the trapping 
potential. The Langevin equation describing the dynam- 
ics of the SPP in trap is, 



v = —~/(v)v — kx + r](t) 



(38) 



so that 7(f) = 7 — a + bv 2 . By multiplying the above 
equation with v we get a Langevin equation for the time 
evolution of the Hamiltonian 



dH 

~~dt 



-j(v)v 2 + rj{t).v 



(39) 



at v = ±v with vq = y/(a — "f)/b. 
characterized by x — xq sin(wi + < 



where H — v 2 /2+kx 2 /2. In the deterministic limit of 77 = 
0, the motion goes to fixed points governed by 7(f) = 

The dynamics is then 
f>), v = Vq cos(ujt + </>) 
with uj 2 — k and xq — Vq/ui. The corresponding energy 
near the fixed points H ~ Hq = Vq. 

The stochastic dynamics near these fixed points is gov- 
erned by the following Langevin equation obeyed by the 
Hamiltonian 148] 



dH 
~dT 



-jhH + vH~r] 



(40) 



where 7^ = 7— a+bH. The corresponding Fokker-Planck 
equation 



dP H {H,t) _ d 
dt ~ dH 



{ 1H H - D )P H + D ^(HP H ) 



has the steady state solution 



p s (H) =^lexp 



- Wq I , H dH 



(41) 
(42) 



The most probable energy is given by the fixed point 
H = \v 2 + \kx 2 — H Q where ^h{H ) = 0. Thus near 



H = Hq we can expand 7^ as 

1H = b(H - Ho) 
to obtain 

b 



Ps(H) = Acxp 



2D, 







(H - H y 



(43) 



(44) 



Thus in this case the steady state probability distribution 
is 



p s (x,v) = Me 



-HoV 



(iu'x'-Hou'x*) -%-u 



.M(l,.,*^ 



(45) 



The most interesting part of this distribution is the term 
exp[— (fivLa 2 /2) x 2 v 2 ) which denotes that the particles 
with higher kinetic energies tend to locate near the cen- 
tral region of minimal potential, and the less mobile par- 
ticles stays near the periphery. 

We can now determine the change in steady state 
entropy as the initial steady state characterized by 
p s (i)i,0) fEq IM)) is transformed to p s {x,Vf) given by 
Eq. (|4"5|) . The change in system entropy is As/ks — 
— lxi\p a (x, Vf)/p a (vi,0)] and can be expressed as 



As / A0 

— = 0[AE + -Z 

kb V 7 



■ 7 (y f +u x ) 



- (a - l)wV + vu?x 2 v 2 s \ . (46) 

The total entropy production in a trajectory (EqJHJ), 



As t _ p 
k B 2 

- P[(a - I) AW - vAW ] 
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(Vf + uj x ) — (a — l)u> x + vlo x Vt 



(47) 



follows the integral and detailed fluctuation theorems 
given by Eq.s © and (fT5)) . 



C. The energy depot model 

Within the energy depot model [42j , an SPP is capable 
of taking up external energy and store it in the internal 
energy depot, then transducing the energy into kinetic 
energy. A part of the stored energy is dissipated during 
conversion into kinetic energy. Thus the energy balance 
equation for an internal energy e(t) can be given by, 



de(t) 

dt 



= q(r) - ce(t) - h(v)e(t) 



(48) 



where q(r) is the space dependent rate of energy uptake, 
and h(v) is the rate of conversion of internal energy to ki- 
netic energy. In a particular simple version of the model, 
one makes the choice q(r) — qo, i.e., uniform energy up- 
take and /i(v) = dv 2 , conversion rate proportional to the 



kinetic energy itself. The corresponding Langevin equa- 
tion in Id is written as, 



x = v 

v = —jv + r)(t) + ae(t)v + X 



(49) 



where A is an external force. Assuming that the kine- 
matics of internal energy is much faster than diffusion, 
one replaces e(t) by the steady state energy eo = c+ g ^ v2 . 
Then the self propulsion force is given by, 



F(v) = ae$v 



c + dv 2 



(50) 



In the limit of small velocities this model reduces to the 
Rayleigh-Helmholtz model F(v) = 71 1> — 72V 3 where 71 = 
aq Q /c and 72 = aq^d/c 2 . 

All the forces in the Langevin equation can be clubbed 
together to —ip'(v) = —jv + A + aqov/(c + dv 2 ) leading 
to VK W ) = \l v2 — Xv + <fi(v) with the velocity dependent 
potential 



t(v) = -^\n(c + dv 2 ). 
Thus using Eq |16[ the steady state distribution is 



Ps(X,v) 



dv 2 )aqo /2D d g -\ 



v' + 



Do . 



(51) 



(52) 



The steady state entropy production due to a trans- 
formation from initial state p s (X,Vi) to a final state 
p s (X,Vf) is obtainable from EqfTHl with AW = Xj dtv, 
A{fv) = X(v f -Vi) and AQ em = (A/7) f dtv/{c + dv 2 ). 
This entropy production at NESS will obey the integral 
as well as the detailed fluctuation theorems. 

The linear response around A — steady state can be 
expressed in terms of the modified fluctuation dissipation 
relation Eq.(f2"2"]l with F(v) given by Eq.fJSD}, such that 



x {t,t') = P{v{t)v{t'))~^(v{t) 



v(t>) 



c + dv 2 (t') 



(53) 



propelled particles. Our calculations show that the veloc- 
ity dependent potential as a mechanism of self propulsion 
leads to associated excess entropy production, which is 
absent in traditional Brownian motion driven out of equi- 
librium by external force. Calculation of entropy in SPPs 
has gained recent experimental interest in measurements 
of force generation by molecular motors using the de- 
tailed fluctuation theorem [24J, |25j . 

Further, we have characterized the steady state re- 
sponse function in terms of a modified fluctuation- 
dissipation relation. This in general has an addi- 
tive correction due to self propulsion, compared to the 
fluctuation-dissipation theorem at equilibrium. Due to 
the close relation between the Rayleigh-Helmholtz model 
and the motion of microtubules under collective influ- 
ence of a type of Ned mutant NK11 [4l|, |49| . our pre- 
dictions on entropy production and fluctuation theorem 
in the context of Rayleigh-Helmholtz model are particu- 
larly amenable to experimental verification. We plan to 
extend the current formalism to SPPs moving in higher 
dimensions. 
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Appendix A: Ratio of probabilities 

The ratio of the probabilities of the forward and reverse 
paths comes out to be 



V- 



exp 
exp 



H' dt (' +d I- m h ) 



— dt(-"fv + 7] + F(v))(--/v + F(v)) 
D v Jo 



CONCLUSION 



(Al) 



We have presented a fluctuating thermodynamic de- 
scription of self propelled particles. This enabled us 
to identify a production of fluctuating entropy associ- 
ated with non-equilibrium processes in SPP. We have 
shown that the trajectory averaged entropy gets maxi- 
mized in non-equilibrium processes, playing a role simi- 
lar to that of thermodynamic entropy in equilibrium ir- 
reversible processes. 

For a simple model of molecular motors, we utilized 
this description to calculate the total fluctuating en- 
tropy production. This has been done for two cases: 
(i) at non-equilibrium steady state, (ii) transformation 
between oscillatory non-equilibrium states. We fur- 
ther studied entropy production in a model of non- 
linear velocity-dependent friction, namely, the Rayleigh- 
Helmholtz model, and in the energy-depot model of self 



where in the last step we used the Langevin equation and 
the expression of g(v). The terms in the exponential can 
be rewritten in the form 



dt(-jv + i])(-jv) + F(v)(F(v) - 2jv + rj) 



-7AQ+I 



(A2) 



where the definition of AQ is used from the first law 
Eq.Q, with the second term 



X 



dtF(v)[v-iv-(f(t)-d x U)] 



dt 



v-£ + jv.F(v) + F{v).(f(t) - d x U) 



-Acj> - jAQ m - 7 AQ £ 



(A3) 



In the first term in the expression of X, we have as- 
sumed F(v) — —d(f)(v)/dv and thus /J" dtv.d v (j)(v) = 
(j>(v(r)) — (j)(v(0)) — A(j), the change in velocity depen- 
dent potential. The second term AQ m = J dtv.F(v) is 
defined in the first law. In the third term we used the 
definition -yAQ em = f dtF(v).(f(t) - d x U). Thus we 
get the ratio in Eq.©. 



where we used Asf(X) = — As r (X'l'), i.e., the final distri- 
bution of the forward process is assumed to be the same 
as the initial distribution of the reverse process, and vice 
versa Q- This assumption is valid at steady states, equi- 
librium or non-equilibrium. 



Appendix B: Detailed fluctuation theorem 



It follows from Eq.Q that the probability distribution 
of entropy production [7|, |9[ 



p(As t ) -- IV[X]P f (X)S(As t -A Sf (X)) 

V[X}P r (Xl)e As f/ kB S(As t - As f (X)) 
^As t /k B j V [x^]P r {X^)5{As t + As r (X f )) 



e As */ feB p(-As t ) 
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